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Accuracy standards have been developed to ensure that the waveforms used for gravitational-wave 
data analysis are good enough to serve their intended purposes. These standards place constraints 
on certain norms of the frequency-domain representations of the waveform errors. Examples are 
given here of possible misinterpretations and misapplications of these standards, whose effect could 
be to vitiate the quality control they were intended to enforce. Suggestions are given for ways to 
avoid these problems. 
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I. INTRODUCTION 

Model waveforms are used in gravitational-wave data 
analysis in two different ways. A signal is first identi- 
fied in a detector's noisy data stream when it is found to 
have a significantly large projection onto a model wave- 
form. If the model waveforms were not accurate enough, 
then an unacceptably large fraction of real signals would 
fail to be detected in this way. The second use of model 
waveforms in gravitational-wave data analysis is to mea- 
sure the physical properties of any signals identified in 
the first detection step. These measurements are per- 
formed by fine tuning the model-waveform parameters 
(e.g., the masses and spins of the sources, the source's 
orientation, the times of arrival of the signals, etc.) to 
achieve the largest correlation with the data. If the model 
waveforms were not accurate enough, these measured pa- 
rameters would fail to represent the true physical prop- 
erties of the sources to the level of precision commensu- 
rate with the intrinsic quality of the data. So separate 
waveform- accuracy standards have been formulated to 
prevent these potential losses of scientific information in 
the detection and measurement phases of gravitational- 
wave data analysis [3, 0| • 

These accuracy standards are expressed as limits on 
the waveform-modeling errors 5h m , i.e., the difference 
between a model waveform, h m , and its exact counter- 
part, h e : Sh m = h m — h e . Model gravitational waveforms, 
and the errors associated with them, are most easily de- 
termined as functions of time: 5h m (t) — h m (t) — h e {t). 
In contrast gravitational-wave data analysis and the ac- 
curacy standards for model waveforms are most conve- 
niently formulated in terms of the frequency-domain rep- 
resentations of the waveforms and their errors, 5h m {f). 
The time and frequency representations of waveform- 
modeling error are related to one another by the Fourier 
transform: 



Sh m (f) = / 5h m (t)e- 2 * ift dt. 



(1) 



(This paper follows the convention of the LIGO Scientific 
Collaboration [3j and the signal-processing community 
by using the phase factor e -2 ^^' in these Fourier trans- 
forms. Most of the early gravitational wave literature 
and essentially all other computational physics literature 



use e 27 ™^*, but this choice does not affect any of the sub- 
sequent equations in this paper.) 

The simplest way to express the standards needed to 
ensure the appropriate levels of accuracy for model grav- 
itational waveforms is to write them in terms of a par- 
ticular norm of the model- waveform errors: (Sh m \dh m ) . 
This norm, defined by 



(ShmlShn 



Sh m (f)Sh* m (f) 

Sn(f) 



df, 



(2) 



weights the different frequency components of the wave- 
form error by the power spectral density of the detector 
noise S n (f). In terms of this norm, the accuracy require- 
ment that ensures no loss of scientific information during 
the measurement process is, 



(Sh m \Sh m ) < 1, 



(3) 



cf. Eq. (5) of Ref. |l[. Similarly the accuracy require- 
ment that ensures no significant reduction in the rate of 
detections is, 



(8h m \Sh m ) < 2e max p 2 



(4) 



where p is the optimal signal-to-noise ratio of the de- 
tected signal, and e max is a parameter which determines 
the fraction of detections lost due to waveform-modeling 
errors, cf. Eq. (14) of Ref. [l|. 

These basic accuracy requirements, Eqs. © and ([!]), 
assume the detector is ideal in the sense that any mea- 
surement errors made in calibrating the response function 
of the detector are negligible compared to the waveform- 
modeling errors. It is more realistic to expect that 
the detector will be calibrated only to the level of ac- 
curacy needed to ensure the calibration errors satisfy 
approximately the same accuracy requirements as the 
waveform- modeling errors. In that case the modeling- 
accuracy standards must be somewhat stricter than those 
for the ideal-detector case Q. Assuming equal calibra- 
tion and waveform-modeling errors, the modeling accu- 
racy requirement for measurement becomes 



(Sh m \Sh r , 



< 



4' 



while the requirement for detection becomes 



(Sh m \Sh Ti 



< 



-max 2 



P ■ 



(5) 



(6) 



2 



To keep things as simple as possible, this discussion uses 
these somewhat stronger accuracy requirements. How- 
ever, none of the potential abuses nor any of the methods 
discussed here to avoid these problems depend critically 
on what the ratio of the waveform-modeling error to cal- 
ibration error is ultimately chosen to be. 

The discussion of various possible misapplications of 
the accuracy standards in the following section will be 
simplified by introducing a little more notation. It is 
useful to define the logarithmic amplitude, %, and the 
phase, $, of the frequency-domain representation of a 
waveform in the following way: h = e x+J *. Consequently 
the frequency-domain amplitude and phase errors, 5xm 
and S$ m , of a model waveform are defined as 

h m = eX.+* x «-H«.+«** « K( i + Sxm + i6$ m ). (7) 

It is also useful to define certain averages, Sx m and 8<& m , 
of these waveform-modeling errors: 

<5Xm = / (Sxm) 2Q rpr df, (8) 

and 

s^ 2 ^ j°° {s$ m f 4¥m d f- ( 9 ) 

Jo P 2 S n (f) 

The quantity p that appears in these integrals is the op- 
timal signal-to-noise ratio, defined by 

The weight factor A\h e \ 2 / p 2 S n which appears in Eqs. © 
and ([9]) has the effect of emphasizing those frequency 
components of the errors where the wave amplitude \h e \ 
is large and the noise S n is small. This weight factor has 
integral one; so these are true (signal and noise weighted) 
averages of Sxm and 5<& m respectively. The waveform 
accuracy standards of Eqs. ([5]) and ((6]) take simple and 
intuitive forms when expressed in terms of these averages: 




for measurement and 

Vfe 2 +^<^p, (12) 

for detection. In this form, the accuracy standards 
merely state that the (amplitude and noise weighted) av- 
erages of the combined amplitude and phase errors, Sxm 
and <5$ m , must be less than l/2p for measurement and 
\J Cmax/2 for detection. 

II. POTENTIAL ABUSES 

Several possible misinterpretations of the waveform- 
modeling accuracy standards, Eqs. pip and (|12[) . are dis- 
cussed in this section. These fallacies can (although not 



necessarily always will) result in false conclusions about 
the suitability of model waveforms for gravitational-wave 
data analysis. Methods for avoiding these potential 
abuses are presented as part of the discussion of each 
fallacy. 



A. Maximum Error Fallacy 

The waveform-modeling accuracy standards expressed 
in Eqs. (fTTj) and (fT2|) are easy to understood as require- 
ments on the average values of the amplitude and phase 
errors of the model waveforms. When assessing the ac- 
curacy of the waveforms produced by numerical simula- 
tions, it is natural and reasonable to attempt to estimate 
their errors by producing graphs, such as those in Ref. (4j, 
showing the time dependence of the differences in the 
amplitudes and phases of the model waveforms produced 
by simulations at different numerical resolutions, etc. It 
would be tempting to conclude that the waveforms in 
question are good enough whenever such graphs indicate 
that the maximum amplitude and phase errors of the 
model waveforms satisfy the inequalities of Eqs. pip and 
p2p . If the maximum errors satisfy the required inequal- 
ities, then it seems reasonable to expect that any average 
of these errors would satisfy the inequalities as well. 

Unfortunately this would be wrong, for a long list of 
reasons. For the purposes of this discussion, let us put 
aside the issue of systematic errors (e.g., failure to im- 
pose purely outgoing, non-reflective, constraint preserv- 
ing outer boundary conditions, or failure to extract the 
waveform in a gauge invariant way, etc.) which can not 
be measured simply by performing convergence tests on 
a series of simulations. Rather let us focus on the nar- 
row issue of whether it is sufficient to guarantee that the 
maximum errors in the time-domain representations of 
the waveforms satisfy the inequalities specified in the ac- 
curacy standards. 

The fundamental misinterpretation that leads to this 
fallacy is the blurring of the distinction between time- 
domain and frequency-domain representations of the 
waveform errors. While fairly straightforward, the 
Fourier transform that connects these representations 
is non-local, and does not map the amplitudes and 
phases of one representation into the amplitudes and 
phases of the other in a simple way. In particular, it 
is fairly easy to construct examples which demonstrate 
that even when the maximum values of the time-domain 
amplitude and phase errors, 5p x = max |<5xm(^)| and 
Spq, = max |<5$ m (t)|, satisfy the accuracy standards, 
Eqs. (fTTj) and p~2|) , there is no guarantee that the anal- 
ogous frequency-domain averages, 5x-m and <5$ m , do as 
well. 

The time-domain representation of any exact waveform 
can be expressed in terms of an amplitude, A e (t), and 
phase, & e (t), 

h e (t)=A e (t)cos[$ e {t)]. (13) 



Here and throughout the remainder of this paper the 
time-domain waveform h e (t) is taken to be real, consist- 
ing of the particular combination of + and x polariza- 
tions observable by a particular detector. Similarly the 
time-domain representation of the corresponding model 
waveform can be written as 

h m (t) = A e (t)[l + 5 Xm (t)] cos[$ e (i) + 5<P m (t)} (14) 

where Sxm and S^ m represent (real) time-domain ver- 
sions of the logarithmic amplitude and phase errors. It 
is useful to express these errors in the form 



5(i® g<s>{t), 



(15) 
(16) 



where g x and <?$ are taken to satisfy |g x (i)| < 1 and 
l<?*(OI — 1j so the constants 8^i x and represent the 
maximum errors. The goal of this example is to find fairly 
"realistic" error functions S X m(t) and 5& m (t), having the 
property that S[i x and <fyt$ are less than the correspond- 
ing averages Sxm and 5<f> m . Any such example would 
demonstrate that limiting the time-domain maxima, 6/j, x 
and 6 with the inequalities in the accuracy standards 
is insufficient to guarantee that the actual standards are 
satisfied. 

To guide our selection of the error functions g x and 
g$ for this example, let us examine the estimates of 
§Xm(t) and 6$ m (t) from actual numerical simulations, 
e.g., Figs. 6-8 of Ref. It appears that in some simula- 
tions at least, the waveform errors can have fairly mono- 
chromatic oscillatory time dependence with frequencies a 
few times the basic gravitational-wave frequency. So let 
us consider error functions of the form: 



g x (t) = g$(t) = cos[A$ e (i)], 



(17) 



where the parameter A sets the frequency of the errors 
relative to the basic gravitational-wave frequency. The 
waveform errors, Eq. (| 1 T[) for this example, are combined 
with the "exact" waveform functions A e (t) and Q e (t) to 
produce h m (t) according to Eq. (fl"4"l) . For the purposes of 
this example, the exact waveform h e (t) is taken to be one 
obtained by patching a post-Newtonian waveform onto a 
numerical waveform from an equal-mass non-spinning bi- 
nary black- hole simulation Once assembled this ex- 
ample waveform error, 5h m (t) = h m (t) — h e (t), is Fourier 
transformed numerically, and the result used to evaluate 
the average error quantities 8xm and 5Q m according to 
the prescriptions in Eqs. fl5|) and (0). 
The ratio R, defined by 



R 



\ 



8 X r 



(18) 



measures how faithfully the maximum time-domain er- 
rors, Sfi x and <5/i$, estimate the averages Sx m and 8Q m . 
When R > 1 the maximum time-domain errors under- 
estimate the frequency-domain averages of these errors, 
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FIG. 1: Shown is R, the ratio of the proper frequency-domain 
waveform error measure to the simple time-domain maximum 
measure, for a range of masses and values of the frequency 
parameter A. When R > 1 the accuracy standards could 
be violated if the simple maximum error measure were used 
instead of the proper frequency-domain measure. 



and could not be used therefore to verify the waveform 
accuracy standards. The ratio R is (essentially) inde- 
pendent of 6/i x and <5/i$ in the limit of small Sfi x and 
5fi<j, . Figure Q] illustrates R as a function of the total 
binary black-hole mass for several values of the parame- 
ter A. The averages Sxm and 5$> m were computed here 
using an Advanced LIGO noise curve @ , and maximum 
time-domain errors Sfi x = <5/i$ = 0.01. It is not hard to 
imagine how model- waveform errors, having frequencies a 
few times the fundamental gravitational-wave frequency 
(e.g., from inadvertent excitations of the individual black 
holes), could enter even the best numerical simulations. 
This example shows that in such cases the frequency- 
domain error averages, Sx m and <5$ m , could exceed the 
simple time-domain maxima, 8[i x and Sfi<j>, by a signifi- 
cant amount. It would be an abuse of the accuracy stan- 
dards therefore to conclude that model waveforms are 
suitable for gravitational-wave data analysis simply by 
verifying that their maximum time-domain errors satisfy 
those conditions. The cure for this fallacy is straightfor- 
ward: don't use the time-domain maxima as surrogates 
for the relevant signal and noise weighted averages when 
enforcing the waveform-accuracy standards. 



B. Error Envelope Fallacy 

The discussion of the maximum error fallacy in 
Sec. Ill Al shows that a proper application of the 
gravitational-waveform accuracy standards, Eqs. (|11|) 
and (|12p . requires more information about waveform er- 



4 



rors than a simple knowledge of their time-domain max- 
ima. What additional information is needed? Rather 
than tackle that difficult question directly, let us con- 
sider instead a more modest question: What additional 
information about waveform errors is likely to be avail- 
able? A complete knowledge of the waveform error 
8h m (t) will obviously never be available to verify the 
accuracy standards. If it were, the exact waveform, 
h e (t) = h m (t) — 5h m (t), would also be known, and there 
would be no need for any waveform accuracy standards. 
It seems likely that the most that will ever be available 
are reliable local- in-time bounds on the waveform errors. 
Careful convergence tests together with a detailed anal- 
ysis of all the systematic errors, could plausibly produce 
error-envelope functions, 8xE(t) and 8<&E{t), having the 
property that they strictly and tightly bound the wave- 
form errors: 

SXE(t) > \S Xm (t)\, (19) 
8§ E (t) > \8$ m (t)\. (20) 

Given such error-envelope functions, it would be straight- 
forward to construct the full model-waveform error func- 
tion, 6h,E(t), based on them: 

5h E {t) = A m (t)[l + 6xE{t)]cos[$ m (t) + 6$ E (t)} 
-A m (t) cos[$ m (f)], 
~ An (Sxe cos $ ro - 5$ e sin $ m ) , (21) 

where A m and <E> m are the amplitude and phase of the 
model waveform. This waveform error estimate, Sh,E(t), 
could then be Fourier transformed and the resulting 
frequency-domain error estimate used to construct the 
averages 5\e and 8$e in a fairly straightforward way. It 
seems reasonable to expect that the resulting S\e and 
5<&e would be upper bounds on the actual waveform er- 
ror averages Sx m and SQ m needed for the accuracy stan- 
dards. So these error-envelope estimates should be ex- 
actly what are needed to enforce the accuracy standards 
in a rigorous and reliable way. 

Unfortunately this would be incorrect: error envelopes 
produce error averages 5\e and 8&e that are not in gen- 
eral upper bounds on the needed waveform error averages 
Sxm and 8$ m . Consequently they are not a useful test 
of whether the accuracy standards are actually satisfied 
or not. A very simple example of this failure can be seen 
in the example introduced in Sec. Ill Al to illustrate the 
maximum error fallacy. The maximum time-domain er- 
rors, (5/i x and <5/z$, can be used to construct very simple 
(constant in time) but crude error envelope functions: 

S XE (t) = 6[i x > \S Xm (t)\, (22) 
S$ E (t) = fy# > |**m(*)|- (23) 

The A = case in Eq. (fTT]) corresponds to this choice 
of envelope function. It is obvious from Fig. [T] that the 
error envelope case, A = 0, has smaller values of Sxm and 
8<$> m than any of the other cases. So this simple example 
illustrates that in general, the error-envelope estimates, 








FIG. 2: Example of a time-domain waveform error, g(t), and 
an envelope function G(t) that satisfies G(t) > \g(t)\. 



Sxe and S$e, do not provide upper limits on the needed 
waveform error averages 8xm and SQ m . 

The fundamental misconception leading to the error 
envelope fallacy is the expectation that local-in-time 
bounds, e.g. G(t) > \g(t)\, lead to analogous bounds 
on the frequency-domain representations of those func- 
tions, i.e., G(f) > |<?(/)|- It is easy to find examples that 
illustrate that this is not the case. The exemplar model- 
waveform error g(t), shown as the dotted curve in Fig. [21 
is bounded by the envelope function G(t) shown as the 
solid curve in this figure. The Fourier transforms of these 
functions produce the frequency-domain representations 
g(f) and G(f) illustrated in Fig. [31 The basic problem is 
that the error-envelope function does not place any limit 
on the frequency content of the function it bounds. So 
in the frequency domain, the actual error represented by 
g(f) can be much larger for some frequencies than the 
envelope function G(f). This can lead to waveform-error 
averages, Sxm and SQ m , that are much larger than those 
based on the envelope functions, Sxe and 8&e- This can 
occur when the weight function used in Eqs. © and © 
is large in the frequency range where the waveform er- 
rors are large, and small in the frequency range where 
the error envelope is large. 

In the discussion above, it was argued that the error- 
envelope functions, #Xe(£) and i54>^(i), are probably 
the most information about the actual waveform errors, 
8Xm(t) and <5$ m (i), that will ever be available. So un- 
fortunately the error envelope fallacy suggests that the 
waveform-accuracy standards, Eqs. (fTTj) and (I12|) . may 
never be enforceable. 

Fortunately, this too would be incorrect: there is a way 
to enforce the accuracy standards rigorously with only an 
error-envelope estimate of the actual waveform-modeling 
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FIG. 3: Frequency domain representations of the model wave- 
form error and envelope functions, g(f) and G(f), whose 
time-domain representations appear in Fig. [2] The envelope 
function G(f) obviously fails to provide a local bound on the 
frequency-domain error <?(/). 



error. Parseval's theorem provides a direct, exact, con- 
nection between the norms of time-domain functions and 
their frequency-domain counterparts. In particular, the 
L 2 norm of the time-domain waveform error, 



\\th m (t)\\ 2 = / \Sh m (t)\ 2 dt, 



(24) 



is identical to the L 2 norm of its frequency-domain coun- 
terpart: 



||^ m (t)|| 2 = \\Sh m (f)\\ 2 , 

\Sh m (f)\ 2 df. 



(25) 



An important feature of these L 2 norms is that local- 
in-time bounds also provide bounds on the frequency- 
domain L 2 norms. So if G(t) is an envelope function for 
g(t), then the L 2 norm ||G(i)|| bounds the L 2 norms of 
git) and g(f): \\G(t)\\ > \\g(t)\\ = \\g(f)\\. In this way 
the error-envelope waveform 8fiE(t) provides an upper 
bound on the L 2 norm of the frequency-domain error 
Sh m (f). Keeping terms in Eq. (fl"4"|) to first order in Sxm 
and 5& m , if follows (using the triangle inequality) that 



||*M*)II < \\A m (t)5x m {t) cos[$ n 

+\\A m (t)8$ m (t) sm[$ r , 
< \\A m (t)5xE(t)cos[$ m (t)}\\ 

+\\A rn (t)5$E(t)sm[3> m {t)}\\, (26) 

Therefore, error-envelope waveforms would be useful in 
applying the accuracy standards if they could be re- 
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FIG. 4: Curves illustrate C, the ratio of the standard signal- 
to-noise measure p to a non-standard measure defined in 
Eq. (|29[) . as a function of the total mass for non-spinning 
equal-mass binary black-hole waveforms. Dashed curve is 
based on the Initial LIGO noise spectrum 0]; solid curve is 
based on an Advanced LIGO noise curve [f|. 



formulated in terms of L 2 norms, ||<$/i m ||, rather than 
noise- weighed inner products (5h m \Sh m ) . 

Fortunately again, the accuracy standards have been 
re-written in terms of the L 2 norms of the waveform er- 
rors In particular, the accuracy standard for mea- 
surement, corresponding to Eq. ([5]), becomes 



ll*M*)ll 



< 



i 



C\\h m {t)\\ 2p' 

and the standard for detection, corresponding to Eq. 
becomes, 



(27) 



C\\h m (t)\\ 



\\5h m (t)\\ 

/ c max 



(28) 



The quantity C that appears in these inequalities is the 
ratio of the standard signal-to-noise measure p to a non- 
standard signal-to- noise measure based on L 2 norms: 



c2 _ j (2\\h m (t)\\ 2 



9 



(29) 



This quantity is dimensionless, and independent of the 
absolute scale (i.e., the distance to the gravitational- wave 
source) of the waveform. Figure H] illustrates C as a 
function of the total mass for non-spinning equal-mass 
binary black-hole waveforms constructed by patching to- 
gether the waveform produced by a numerical simulation 
with a post-Newtonian waveform [3, 4, 5]. The quantity 
C can be evaluated in a straightforward way whenever 
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model waveforms are computed. Using Eq. (I26p . it fol- 
lows that the accuracy standards can also be written as 
conditions on the error envelope functions SxE(t) and 
8$>E(t)- These conditions are, 



\\A m (t)S XE (t) cos[$„ 
C\\A m (t) cos[* m (i)]|| 
{t)5<S> E {t) sin[$ 

r. 



+ 



C\\A m (t) cos[$ 



< 5-, (30) 
2p 



for measurement, and 

\\A m {t)§XE{t) cos[$ r , 



C\\A m {t) cos[$ 
, ||A m (t)5$ B (t)sin[^ 



.(*)]!! 



C||A m (t) cos[$ m (t)]|| 



< 



(31) 



for detection. 

This discussion shows that using error-envelope esti- 
mates of the waveform-modeling errors in a naive appli- 
cation of the gravitational- waveform accuracy standards, 
Eqs. pTjl and (TT!>|) . would be an abuse of those standards. 
Fortunately, error-envelope estimates can be used to en- 
force the accuracy standards rigorously when they are re- 
formulated in terms of the L 2 norms of the errors. The 
use of the L 2 norms rather than the noise- weighted norms 
prevents the suppression of any frequency components of 
the envelope functions. This ensures that the envelope 
functions provide real bounds on the norms of the actual 
errors, Eq. thus making them useful for enforcing 

the accuracy standards. So the cure for the error en- 
velope fallacy is straightforward: use the time-domain 
L 2 norm versions of the accuracy standards, Eqs. (f3"01) 
and (|3ip , instead of the frequency-domain noise- weighted 
norm versions, Eqs. (fTlj) and (fTj 



C. Universality Fallacy 



The discussion of the error envelope fallacy in Sec. Ill Bl 
shows that it can be avoided by adopting versions of the 
accuracy standards based on L 2 norms, Eqs. (f3"0|) and 
(|3ip. rather than noise- weighted norms. The L 2 norm 
versions of the standards are complicated however by the 
appearance of the quantity C, defined in Eq. (f!Z5)) . This 
quantity depends on the waveform and the detector noise 
spectrum, and can be evaluated in a straightforward way 
whenever a model waveform is computed. For exam- 
ple, Fig. 2] shows C as a function of mass for equal-mass 
non-spinning binary black-hole waveforms, cf. Fig. 4 of 
Ref. Q. 

It has been argued that the quantity C is universal: the 
same for all gravitational waveforms of a given type 
Thus it was believed that Fig. 2] represents all equal- 
mass non-spinning binary black-hole waveforms. This 
however is clearly wrong. The norm ||/i m ||, which ap- 
pears in the expression for C in Eq. (f!?5)) , depends on the 
length of the waveform: having different numerical val- 
ues when computed for model waveforms with different 
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FIG. 5: Curves illustrate C, the ratio of the standard signal- 
to-noise measure p to a non-standard measure defined in 
Eq. (|29[) . as a function of the total mass for non-spinning 
equal-mass binary black-hole waveforms. Various curves use 
gravitational waveforms containing different numbers of grav- 
itational wave cycles, indicated by the parameter N cyc \ CB . 



numbers of wave cycles. Consequently C too will depend 
on the length of the waveform, in addition to the wave- 
form's other physical properties. This non-universality 
is illustrated in Fig. [5l where C is shown for equal-mass 
non-spinning binary black-hole waveforms (constructed 
by patching a waveform from a numerical simulation onto 
a post-Newtonian waveform 0, Q) containing different 
numbers of gravitational-wave cycles. Each of the wave- 
forms used to produce these curves includes the merger 
and ringdown of the final black hole, but different num- 
bers of wave cycles from the inspiral portion of the bi- 
nary evolution. The length (in time) of each successively 
shorter waveform used in Fig. [5] is one eighth that of its 
predecessor; the number of wave cycles is indicated for 
each waveform by the parameter N cyc \ es . 

It would be a mistake for the waveform simulation com- 
munity to attempt to validate the accuracy of a model 
waveform by combining an error-envelope estimate of 
I l^mH/H^mll from one model waveform with the C from 
another. In this case the miss-matched version of the 
measure ||5/i m ||/C||/i m ||, which appears on the left in 
Eqs. ([77]) and ([25]) , would not be the appropriate one 
needed to enforce those standards. The cure for the uni- 
versality fallacy is fortunately straightforward: simply 
determine the quantity C afresh whenever new waveform 
models are computed, and then evaluate the entire error 
measure ||<5/Jm||/C||/i m || from the same model waveform. 

An analogous abuse of universality could potentially 
also occur with the quantity, C, used as part of the com- 
bined calibration and waveform-modeling accuracy stan- 
dards for gravitational- wave detectors [2| . This quantity 
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FIG. 6: Curves illustrate C, the ratio of the standard signal- 
to-noise measure p to another non-standard measure defined 
in Eq. (|32p , as a function of the total mass for several non- 
spinning equal-mass binary black-hole waveforms. This quan- 
tity is used to enforce calibration accuracy standards for grav- 
itational wave detectors. 



is defined by 



where the total detector noise, n, is 



°n 



(32) 



(33) 



The quantity C also depends on the length of the gravi- 
tational waveform. Illustrated in Fig.[6]are several curves 
showing C as a function of mass, computed for the same 
waveforms of varying length used to compute the curves 
in Fig. [5l It would be a mistake to attempt to enforce 
the combined calibration and waveform-modeling accu- 
racy standards of Ref. [2| using C and C computed from 
different waveform models. 



III. DISCUSSION 

This paper has identified several possible misinterpre- 
tations and misapplications of the waveform-modeling 
accuracy standards. These potential abuses could result 
in the use of substandard model waveforms for gravita- 
tional wave data analysis with a consequent loss of sci- 
entific information. This paper also outlines a series of 
steps that should be taken to avoid these problems: 

• Use the specified waveform error norms when 
applying the accuracy standards, not surrogates 



based on estimates of the maximum time-domain 
amplitude and phase errors for example. 

• Construct careful error-envelope estimates of the 
time-domain amplitude and phase errors, and use 
these in the L 2 norm versions of the accuracy stan- 
dards given in Eqs. (|30p and ([31]) . 

• Use the same model waveforms to construct the 
error-envelope estimates of the waveform error 
norms, ||<5/i m ||/||/i TO ||, and the quantities C and C 
that appear in the combined waveform-modeling 
and calibration accuracy standards. 

The L 2 norm versions of the accuracy standards, 
e.g., Eqs. (|27p and (|28| . place limits on the allowed 
values of a particular measure of the waveform er- 
ror: ||<$/i m ||/C||/i m ||. A disturbing feature of this 
error measure is the fact that the quantity C can 
be rather small, resulting in very stringent require- 
ments on the L 2 norm measure of the waveform er- 
ror, ||<5/i TO ||/||/i m ||. Figure 0] illustrates for example 
that C can be as small as 0.02 for 400M Q black-hole 
binary systems and an Advanced LIGO noise curve. 
This implies that the L 2 norm measure of the wave- 
form errors, ||#/i m ||/||/i m ||, must be about fifty times 
smaller than the requirement on the noise-weighted 
inner-product measure, yj (Sh m \Sh m ) / y (h m \h m ). The 
waveform-accuracy standard for detection in LIGO 
would require \\Sh m \\/\\h m \\ < 0.001 instead of 
\J (Sh m \8h m ) I yj (h m \h m ) < 0.05 for example. This dis- 
parity in the level of accuracy required for these different 
error measures seems unreasonable. It isn't clear (be- 
cause no one has actually checked yet) whether any of 
the currently available model waveforms come close to 
satisfying the preferred L 2 norm accuracy standard, even 
the relatively weak standard for detection. Is this right? 
What is going on? 

The L 2 norm versions of the accuracy standards, e.g., 
Eqs. P7|) and (|28p . were derived by constructing a se- 
quence of rigorous mathematical inequalities starting 
from the original noise-weighted inner product version 
of the standards, Eqs. (O and (0. Perhaps these in- 
equalities are significantly weaker than optimal, forcing 
the final L 2 norm accuracy standards to be far more re- 
strictive than they really have to be. Having waveform 
accuracy standards that are closer to optimal would be 
quite desirable, if someone could find them. However, 
the chain of inequalities leading to Eqs. (j3"0)) and (pH]) 
appears to be fairly tight. It is possible that a factor of 
two or so has been lost due to sub-optimal inequalities, 
but the loss of a factor of fifty does not seem plausible. 
It seems likely that the main cause of the disparity in the 
accuracy requirements lies elsewhere. 

What explains then the significantly stricter require- 
ment on the L 2 norm measure of accuracy, | |<5/i m ||/| \h m \ |? 
It is easy to show that the \\h m \\ term which appears 
in the denominator of the expression for C, Eq. (|29p . 
is primarily responsible for its very small values in the 
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waveforms of large mass binary black-hole systems. The 
norm \ \h m \ \ scales with mass as M 3 / 2 , while the standard 
signal-to-noise ratio p for binary black-hole signals scales 
approximately as M - 8 . Thus, C scales approximately 
as Af~ - 7 , as shown in Fig. [4] It is inevitable then that 
C becomes very small for large values of M. Figure [5] 
also reveals that C becomes smaller as the length of the 
model waveform becomes longer. In fact, C would ap- 
proach zero as the length of the model waveform becomes 
infinite. This seems very odd. 

Why does the accuracy standard become stricter for 
larger values of the mass and for model waveforms of 
greater length? Recall that the error measure which ap- 
pears on the left in the accuracy standards, Eqs. ([27]) 
and (28]), is \\Sh m \\/C\\h m \\ not \\5h m \\/\\h m \\. The \\h m \\ 
which appears in the denominator of C exactly cancels 
the \\h m \\ which appears explicitly in ||<5/i m ||/C||/i m ||. 
So the size of \\h m \\ (and consequently C) is basi- 
cally irrelevant to the size of the real error measure, 
||<5/i m ||/C||/im||- The requirement on the L 2 norm er- 
ror measure 1 1 8 h m \\/\\ h m \ | only becomes excessively small 
when the reference norm ||/i m || becomes excessively 
large. Two questions arise immediately: Why does it 
make sense to introduce C at all then? Is there a 
real discrepancy between the waveform-accuracy require- 
ment expressed in terms of the L 2 norm error mea- 
sure, ||5/i m ||/C||/i m ||, and the noise-weighted measure, 
a/ (dh m \5h m ) I \f '(h m \h m )? 

Consider first the question of why it makes sense to 
include the quantity C in the statements of the accu- 
racy standards. The accuracy standard for measurement, 
Eq. ([27]) . could be re- written by replacing C with its def- 
inition from Eq. 



\\Sh m \\ < 



- v /min5 Tl (/) 
2\/2 



(34) 



This expression is quite simple, but it has the disad- 
vantage that it only applies when the model waveforms 
and their errors are scaled correctly: by the distance to 
the waveform's source. The model-waveform simulation 
community generally computes only the scaled waveform 
rh m /M and its scaled error rSh m /M. What distance r 
should be used when determining whether a given model 
waveform satisfies the standards? 

It would be more convenient to write the accuracy 
standards in a way that can be applied to model wave- 
forms with any scaling. A natural way to do this is to 
introduce as a natural scale, the L 2 norm of the model 
waveform itself, ||/i m ||. In this case the basic error stan- 
dard, Eq. (fM)) . can be re- written as, 



\\Sh m \\ v /minS'„(/) 



Ml " 2V2\\h„ 



(35) 



The left side of Eq. (j35|) is therefore the natural scale- 
invariant L 2 measure of the waveform error. Unfortu- 
nately, this trick merely pushes the scale problem to the 
right side of Eq. (|33|) . where the \\h m \\ term must still 



be scaled properly wi th the dist ance to the source. The 
quantity v^H'imll/ \/iiim5 rl (/) measures the signal-to- 
noise ratio of the waveform, so specifying its value is 
equivalent to fixing the distance and setting the wave- 
form scale. Since this is not the standard signal-to-noise 
measure p used by the gravitational-wave data analysis 
community, it is natural to introduce the quantity C, the 
ratio of p to this non-standard measure. This allows the 
accuracy standards to be written in terms of the stan- 
dard signal- to- noise measure, as in Eqs. (|27|) and (|28|) . 
Despite the confusing features of these representations of 
the standards (as pointed out above), their advantage is 
that they conveniently depend on the scale of the model 
waveforms only through the standard signal-to-noise ra- 
tio p. 

Finally, consider the question of whether there is a 
real discrepancy between the waveform-accuracy require- 
ment expressed in terms of the L 2 norm error mea- 
sure, ||(5/i m ||/C||ft. m ||, and the noise-weighted measure, 
a/ (Sh m \Sh m ) I (h m \h m ). This question is rather diffi- 
cult, because the actual model waveform error Sh m will 
never be known exactly for real numerically simulated 
waveforms, and so the noise- weighted measure can never 
be known for the reasons described in Sec. Ill Bl The best 
that can be done are explorations of the differences us- 
ing hypothetical waveform errors, and gaining experience 
by applying the proper L 2 norm error measures to real 
model waveforms. At the present time it appears that 
none of the waveform simulation groups have actually 
used these new methods to analyze the accuracy of their 
waveforms. Consequently there is no direct experience 
yet on just how restrictive the L 2 norm accuracy require- 
ment actually is, or whether the simulations currently 
being performed produce waveforms accurate enough ac- 
cording to this measure for LIGO's data analysis needs. 

Until the L 2 norm accuracy measures are explored 
directly by many (most, all) simulation groups using 
their model waveforms, the best that can be done are 
explorations of how restrictive the ||5/i m ||/C||/i m || er- 
ror measure is in a more hypothetical context. The 
graphs showing estimates of the waveform errors, Sxm(t) 
and (5$ m (t), in Ref. Q, suggest that the errors in bi- 
nary black-hole waveforms are largest during the merger 
phase when the amplitude of the wave A m (t) is largest. 
Thus, it seems plausible that carefully constructed error- 
envelope functions, 5xE(t) and S$E(t), for these simula- 
tions will be similarly peaked near the maximum of the 
waveform amplitude, max A m (t). Consider hypothetical 
error-envelope functions of the form, 

A m (t) ' 



5<£> E (t) = 5(11 



max A m (t) 

Am(t) 



max A m (t) 



(36) 



(37) 



where p > is a constant that determines how narrowly 
peaked in time the errors are, and 5^i x and S/iq, are the 
maximum time-domain waveform errors. Using these hy- 
pothetical error-envelope functions, it is straightforward 
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FIG. 7: Curves illustrate R, as defined in Eq. (|38p for wave- 
form errors of the form 8\e = S&e = 5n{A m / max A m ) p . 
The quantity R measures the ratio between the time-domain 
L 2 norm measure of the waveform error, ||<5/i||/C||/i||, and the 
maximum time-domain errors ^/6ji^+5iJ^. 

to evaluate the error measure ||<5/i m ||/C'||/i m ||, or more 
precisely the error-envelope version of this measure from 
the right sides of Eqs. (|30]) and (|3"T]) . It is not possi- 
ble, or at least it is not relevant (as shown in Sec. Ill Bp . 
to compare this error measure with the noise-weighted 
norm measure, \J (5h rn \Sh m ) / -J (h m \h m ). Instead com- 
pare this measure with the more familiar and easy to 
evaluate (yet also not strictly relevant) maximum time- 
domain errors by defining the ratio, 

^ _ \\A m 6xE cos$ m || + \\A m 5^ E sm.^ m \\ . 

C\\A m cos $ m 1 1 yVx + <*/4 

Figure [7] illustrates R computed using the waveform- 
modeling error envelope functions defined in Eqs. (|36|) 
and (|37| . with several values of the parameter p. This 
shows that the proper L 2 norm error measures are com- 
parable to the maximum time-domain errors, for wave- 
form error functions that are narrowly peaked around the 
time of the maximum waveform amplitude. This exam- 
ple makes it plausible that the accuracy standards based 
on the proper L 2 norm error measures are not impossibly 
difficult to achieve for realistic numerical waveform simu- 
lations. Many of the currently available waveforms based 
on numerical simulations may well satisfy the LIGO de- 
tection standard. The waveform simulation community 
needs to explore this further by applying the recently de- 
veloped waveform accuracy standards [J 0] to the model 
waveforms being produced by their groups, and doing 
this in a way that avoids the misuses of those standards 
outlined here. 



The L 2 norm based accuracy standards, Eqs. (|30f and 
(|31[) . are sufficient to guarantee the waveform accuracy 
needed for LIGO data analysis, and these standards are 
probably achievable for realistic waveform errors pro- 
duced by currently available codes. It may be possible 
however to improve these standards somewhat in certain 
cases. For large mass black-hole binaries, only the last 
few orbits contribute significantly to the waveform in the 
frequency range where the detector is sensitive. Yet the 
L 2 norm includes errors from the full length of what- 
ever waveform is tested. The L 2 norm based standards 
are overly restrictive therefore when unnecessarily long 
waveforms are tested, and this will be most pronounced 
for large mass systems. Thus the L 2 norm based accu- 
racy standards could be made more optimal by limiting 
their use to waveforms having the appropriate length. 

What is the optimal length for a gravitational wave- 
form? If the waveforms used for gravitational wave data 
analysis are too short, their frequency-domain counter- 
parts would not be accurate enough to describe the com- 
plete waveform in the full range of frequencies accessi- 
ble to the gravitational wave detector. If the waveforms 
were too long, their L 2 norm error estimates would in- 
clude unnecessary contributions from the early parts of 
the waveform that can have no measurable influence on 
the detector. The optimal length is therefore the shortest 
waveform whose frequency-domain counterpart is accu- 
rate enough in the frequency range where the detector 
is most sensitive. The problem of turning these basic 
principles into useful specifications for optimal waveform 
length has yet to be studied properly. These optimal 
lengths will depend in complicated ways on the total mass 
of the binary system (which sets the frequency scale of 
the waveform), on the noise characteristics of the partic- 
ular detector (which sets the relevant range of frequen- 
cies), on the method used to cut off the early part of the 
waveform (which determines the amount of Gibbs phe- 
nomenon produced in the frequency domain) , and on the 
numerical accuracy requirement on the waveform. These 
issues will be addressed in a future study of this problem. 

One final recommendation: The waveform simulation 
community should compute and publish graphs of the 
quantities C and C whenever new waveforms are pub- 
lished. The quantity C, defined in Eq. (|3l?|) , is needed to 
facilitate the decisions the LIGO experimental and data 
analysis communities must make about setting the ap- 
propriate calibration error levels for the detector Q. 
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